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IBSTEICT 

This paper piovldes a suaaary of a Hoae Statt 
Followup Study (HSFS) which waa Initiated In 1976. An atteapt vas 
aade to exaalne the dorablllty of gains aade as the lesolt of 
failllea* (patents and theli 3'* to 5-yeaE-old children) participation 
in the prograa. In addition* the study vas designed to deteralne 
whether prograa duration (one versus two years) had a lasting effect 
on parents and children as aeasured approiciaately two years after the 
conclusion of the Hoae Start deaonstratlon. The hsfs*s saaple 
consisted of 199 Hoae Statt, it6 Head Start, and 137 coaparlson group 
faallles (faallles who were eligible for but did not participate In 
the prograaW Three sets cf ccaparlaons were conducted: (1) Hoae 
Start faallles versus the coaparison group faallles: (2) Hoae Start 
fatllles versos Head start faallles: and (3) Hoae Start faallles who 
had participated In the prograa fot one year versus a group of Hoae 
Start faallles who participated In the prograa for two years. Five 
aeasurea aere used to deteralne the longtera lapact of the prograa on 
participants* pour of the aeasures were standardized tests for 
children and one was a personal Interview with parents. Sesults - 
Indicated that: (1) while aath and reading perforaance of the Hoae 
Start first graders was lower than the national average, the Hoae 
Start second graders were coa parable with respect to the national 
nora; (2) no significant differences aere found on any of the 
children's outcoae aeatures between the Hoae Start and the Head start 
groups; (3) no differences were found be<;ween the one-year and 
two-jear Hoae Start groups; and (t) aoat faallles were pleased that 
they had been Involved In the prograa and Indicated that the 
activities concerning the child and learning about child 9rowth and 
developaent had been acat laportant for thea. (Author/HP) 
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study BAckground 



thtt ttoo* Start Followup Study^ sponsortd by the ^^dodnistratlon for 
ChlldrttQf Youth and Famlllae, «xanlMd tha long-tarn impact of tlia Boma start 
prograa on i^^j^aM participants* Hdna Start was a thraa-yaar dmonatration 
program (1972«*75) which provided Head Start-type comprahenaive aerricaa to yoong 
children and their fai&lllaa in their own bomea rather than thxou^ a H^^d Start 
center* The program's approach was to offer education # healths nutrition and 
social services to famdLlies with children between three and five yaers of age^ 
and to do ac in a family-oriented rather than a strictly child~orlMtad way* 
Primary emphasis was placed on parents as the first and noet ia^rtant educators 
of their own children* 

The original evaluation of the Hom Start demonstration program 
(1972-76) f conducted jointly 1^ the Hi^Scope educational Research Foundation 
and Abt Asaociatas the* $ provided olaer evidence that Some start vas eff ectiva 
tor both parMta and children* Few dif ferencee were found in terms of program 
affectivanese between Home Start and Head Sta:tt; the overall picture was one of 
similer effects** 

ffhile the original evaluation provided information about iamedlately 
apparent program effects^ the Home Start Followup Study attainted to examine 
the durability of gains made' as the result of ff ilies* participation in the 
* ^ogtm* In addition, the study was designed to determine whether program 



^tove, 3M*t Hauta^ M*J* at al* National Home Start Evaluationi Final 
Iteport— Findings and Implieaticms * High Scope Educational Reeeerdh 
Foundation and Abt Associates Ino*, 1976* 
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duration (on* verau* two yvars) had a lasting •ffcct on parents and children * 
as Masurad approxiaately two year* aftar the conclusion of tha Hooae Start 
deoonstaretion^ Vhm Pollowup Study^ initiated in 1976^ was conducted by Abt 
Associates Inc* under, subcontract with the fiigfa/Scope Educational Research 
Foundation* 

Study Design 

Tik% deeign for the Ftosw Start Followup Study celled tot i a#t of 
cooqparisons of certain outcoM criteria anong different treatawnt groups in 
ordmr to detemlne long*-t€r» progran iMp^ct on p^rente and children* Thm 
outcosM criteria vers cloeely linKed to acne Istart prograA goals and objectlveey 
they Included; 

• personal and parenting skills^ 

• ease of transition to echool and social 
coiqwtence of children^ and 

e cognitive and social enotionel developiaent 
tcx children* 

Three eete of coK^arioons were conducted In the Followup Study: (1) Heme 
Start vereue a group of fAinlliee with children whc were eligible for the 
program but did not participates (2) Home Start versus H^ad Start faallieej 
anA (3) HosM Start famlliee who had participated In the program for one year 
versus a group that had bsen enrolled for two* The first set of cocq;>arisone 
required the selection of a retnspactive coioparison group since a preeelected 
no*treatment group did not exiet at the conclueion of the demonstretion program* 
The ax post facto recruitment of the oosyparison group precluded the poaelbility 
of eetabllehing a true siqperimental design for the Followup Study* 
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Th* ccaparlcon group watt Ml«ct«d from th« tam clastxooos th« 
Hone start childran attandad* Ttna^ tha two groups of chlldran vara 
axpoaad to tha aanc s^iool axparlanca* ; Although tha intant had been to 
recruit a coMparabla coaparlacm group, tha grcmps war^ found to be non* 
equivalent In many reapecta* It la often tha caaa that aophlaticated 
atatlstlcal procedurea^ auch as analyala of oovarlance (AkcoVA) ttcdmlquea* 
can be uaed to correct or adjust for group n<m**4qalvalency* Eowever, this 
la theoretically only poaalbla If the covarlablee are related to oittcoMa 
in the aane way in both groups* Analyala of data froai the PoUowup Study # 
thou^if showed that this Important assuovtlon re^rdlng the uas of AMpCSVA 
was not the case tor any but the one* ^nd two-year ^ioott Start groups* 
ondar these conditions (nonrandoni asslgraoent to groups # group ncn^equiva- 
lancet and heterogeneity of regression) ^ It Is lac»ossible to detemine ^ 
treatmant effects because the status of the ccoparlaon group cannot be 
assuned to represent what would have happened to the eicperlJMntal group bad 
It not received t^e txeatMnt* Hoet ootcone analyses^ as a results were 
necersarlXy lifted to descriptive oooparlsons which do not rirpresant tests 
of treatoent effects n 

Iwpact Measures 

live ttsasuras were used in the Followiqp Study to determine 
Img-tem progra« ii^act on parents and children* Four were standardised 
tests for children**the Peabody individual AchlevaMnt Teat (HatheMtics 
and Reading Rifbognitlon Subcests); the Purdue Social Attitude Scale for 
9riMry crade Childreni the St«phens*Oelys Reinforcement Contingency 
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Int«rvi«w; and the Preschool Int«rpexflonaI Problem* Solving Test* The 
fifth MMure a person&X interview with parents vhich obtained infornta* 
tlon abouc par«it attitudes tomrd and involvenien^, with achooi; parent* 
child interaction; ttatemal end child health; knovledge and use of connunity 
resources; and parent participation in the comuni^* 

rollowup study Saapls 

The Follow Study sanple consisted of 199 Bone Starts 46 H^ad 
Start and 137 comparison groi^ familiss* For the Followup Study it was 
essential that ths compariswt groiq? childrsn*s experiencss during their 
preschool years contrasted as much as poesibls with those of ths Home Start 
group so that groi^ differences could mors easily be attributed to the Borne 
Start program* Kon*participetion in preschool was therefore one of ths 

•w 

most important criteria for selecting comparison group children* The fact 
that the ccmparison group was smaller than ths Home start group can be 
attributed*to lack of school cooperation (a prerequisite for comparism 
group selection) and the abssnce in selected classrooou of ccmparison grc'tp 
children with minimal or no prewhool experience* (About one*third of the 
ccmparison groi^ children in the Followup Study had attended preschool for 
a median time period of three monthe*) ^ 

There wee considsrabie attrition from the original Home' Start 
evaluation samplft-*46 percent for the Home start and 72 percent for Head Start 
QToup* Urban Home Start families appear to be underrepresanted in the 
Followup Study sample^ with over two-thirds of the fem^il^ies coming from ths 
three rural eitee* The Followup Study and the group of Heme Start evaluation 



evaluation finill«s vho did not participate differed in other respects as 
well* Ihn Follovup Study sample was significantly higher on SES/ cognitive 
tests for children and nuniber of books available in the home, t#hile the group 
that could not be located had higher usage of welfare and Medicaid* 

The Follotmp Study confirmed findings from ttie original Home Start 
evaluation that Home Start and Head Start served different populations* 
Statistically significant differences irere found between the two groups in 
the Fbllowup Study in- t^ms of educational attainment of tb« mother/ favoring 
the Haad Start group* More Head Start children came frosi single-'parent 
famiiles/ lived in small towns or urban areas and came frcK smaller households 
than was the case for the Home Start group* the Home Start and Head start 
groups were comparable/ however, on total family and per capita income* 

As noted earlier/ the Home Start and cooqparison grotqps were not 
equivalent In sumy respects* Comparison group families had incomes almost 
twice a# hi0i as the Home Start group and the mother had more years of 
education* ilmong the Home Start group there were more children from single* 
parent families/ hitter use of public assistance/ and a larger percentage 
of families with no income from employment* Gomparisons between tha Bone 
Start and comparison groups could not be carried out excipt descriptively 
beceuse of groi^ non*equivalency and heterogeneity of regreesion* 

Lgng^germ Impact on Children 

Within*grade math and reading performance of the Home Start grottp 
were compared to the national norming aample for this test* Percentiles 
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wert obtaln«d by raferrln? median scores for the group to norm tables in 
the test manual* niese psrcentllee arc In some respects inappropriate, 
since they compare the Hom Start Followup Study sasqple to a nationally 
rspresentativs sample whi'^ is much highar in socio-economic status- If a 
norm group sqaivalMt in SE^ could hav« bsen used, these psrcsntiles would 
hair* bsen higher* Despite this fact, the performance of the Hcow Start group 
was better than expected* Although first grade performance is loner than the 
national avarags (though not too much lower, for reading schieyement) , 
Hosw Start eacond graders were ccMq^arable with respset to tha national norm 
saa^le* In fact, tha second grade percentiles of 49 and 56 for math and 
rea'ling achiavsment, respectiirely, ars the claarsst evidence available in the 
?ollomp Study that, the Hone Start program had a positiva long-term effect* 
The parcMtlla data ars also encouraging because thay show no evidence of a 
so-callad mahout effect; there is no stasdy decline in performance from 
kindargartan through second grade* While it is trua that the data are not 
longitudinal, a positiva view of thesa rasoite nonathalass saams justified* 

Mo significant diffarances wars found an any of the child out* 
cosM measures betwsM the Eoum start and the H^ad Start groupe* As in the 
original avaluatim, tha overall pictura waa one of eimilar long-term program 
effects, even though the Hesd Start children had much mora concentrated time 
In davalopmantal activitiee than was the caee in Home Start* The rola of 
parents as the first and moat isportant educators of their own children 
received primary emphasis in Home Start* 



han^t%xm immct on Parantg 

DMcriptivt analyMc choir th« HoM Start and H<ad Start faAlllaa 
to b« coBparabla In tarns of parent outc^Ma* This SQ99SSts that th« two 
programs nay hava produoad aiodlar long-tarm program affacta for parants* 
thiM hyx^thaaia unfortunataly cannot ba taatad dua to hataroganaity of 
ragraaaion and to tha avail alza of tha Haad Start group, which yialds 
Insttfficianc statistical powar to datact group diffarancas* 

Soatt InfocMl sTidanca was gatharad from Homa Start famiUaa about 

lon9-taxm program impact and thair viaws about participation In Eooa Start* ^ 

Hoat familiaa wara plaasad that thty bad baan involvad In Eoma Start and 
a 

Indicated that aotivitiaa concaming tha child and laaraing about child 
growth and davalo^iant had baan moat isvo^tant to than* Soma of tha parants 
who wara Intarrlawad mora than oncm found it difficult to talk about changaa 
that occurrad as tha raault of thair involiranant In Homa Start* Othara 
Indicated that their ''livas ware batter** and ware aiqrtuitlc about the programme 
helping role* Among r^porta of lasting change werai solutions to family 
prdblams; >^provamanta In family relationehlpe. Including batter (and fre- 
quently more) time itpant with tha cfalldran; job training and eeploymantr 
financial etabiU^j and a mora '^positive'* outlook on Ufa* 

Ona^ Varstts Two^vaar Homa fltart 

One of the principal reeearch qu«stiona the Home start Followup 
Study waa dseignad to addreee waa idiathar two yeare of Home start was mora 
aff activf In producing poeitiva ootcomae f^ parente and children than one 
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y^ar of progras participation* Ho diffarenoas could be datactad batwaan 
tha ona- and two-yaar Hoom atart groupa at tha c<M)cIuaioii of tlia original 
Hoaia start avaluation* It waa hypothaaixad, howavar, that tliara sight ba a 
''ilaapar^ affact, and that diffarancaa batwaan tha grouqpa could anarga two 
yaari aftar tha program andad* It was poa^bda to tait thla hypothaaii In 
tha PoUowup Study, lihca thia waa tha <mly roaponant of tha atady in which 
hataroganaity of ragraaai^ waa not a'problaa* Thara do not.ivpaar to ba 
any diffarancaa <mi parant or child outconaa batwaan tha two groupa that 
could aupport tha notion that two yaara of Hoow Start iB mora af factiva 
than ona* 

It ia poaaibla, howavar, that paranta in fact racaivad additional 
banaf ita from thoir aacond yaar of program participation but that thaaa 
changaa could not ba naaaurad through a ona~hour parant intarviaw* It ia 
iiqKMrtant to ranambar that Born Start provldad diffarant aarricaa to faniliaa 
depanding on thair naada and circunatancas • Although tha ovarall wphaala 
waa to balp paranta baooaia battar taachara of thair ^ildran, tha program 
alao MVhaaixad halping paranta to axparianca auccaaa and acquira akilla that 
wara ralatad to paraonal growth, aocial participation, family managamant, 
anploymant and aconooic prograaa* Homa Start program ataff raportad halping 
paranta with ''aurvival'* naada during tha firat yaar, wbila tha aacond yaar 
waa davotad to mon pararaal and long-ranga aapacta of family functioning* 

During tha wiginal Homa Start avaluation, staff c^tan raportad 
that changaa in paranta' ability to maat family naada with aalactiva uaa of 
aarvicaa, incraaaad abili^ to copa with atraaaful aituationa or Improvad 
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8eIf-concttpt r#qairttd to seek and/or obtain employment %fere only possible for 
some parente after two years In the program* such changes are difficult to 
define and era not easily reported by parents in a one-hour Interview* 
Additional Interviem with emphasis on sudh ^pice might have ^ovided a 
different, richer perspective about the effects of different lengths of 
participation in Hone Start* 

Conclusion 

It is unfortunate that the Booe Start Followup Study could not 
provide a greater sense of clarity and ceirtainty about the long-term ittpact 
of fiome Start because of group non-equivalency and heterogeneity of covariable 
modele* Svidcnce about the long-term in^ct of Home Start on parents and 
children ea e result is indirecti 

1* The perforwmce of Hdme start children on a standardised 
test of reading achievement shows that they ware 
performing at or above the national norm— a level of 
achievement not frequently found among groiqps of low* 
income children* Iheir perfonaance ^ mathematice 
achievement me only slightly below the national noxm* 

2* Despite group differencee In socio-economic status, the 
Home Start and comparison groups ranked^ the same <mi a 
number of outcome domains for parents* 

Thie liqplies that Hbme Start families may have overcome, to some extent/ the 
'*lncoae gap,** and that they are managing their lives In much the same way ae 
familiee who are considerably better c^f * If thie aesun^tion ie correct/ 
Home Start undoubtedly played an iA^rtant part in that* 
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Th« lon9^ttxm effectlvttnMtt'o£ Home Start has n*ith«r b«en prov«n 
nor dl«prov«n by th« Followup Study du« to drcumstmctts that yl«ld«d a 
rsaaarch dsalgn Inadftquata for the purpoas of tha evaluation* Futura evalua* 
tiona «hould ba dealgnad with tha aaaaa«Mnt lon9-tarm affacta in mind 
from tha ootsat* Undar no oircomatancaa shouXd a control group ba ooi^lataly 
abaorbad into tha axparinantal pro^ran If tha poaalblllty exlats that It 
algfat ba uaad in a latar avaluation* Tha difficulty of forming an adaquata 
coaqpariacn group by po«t hoc matching suat not ba undaraatimatadr aapacially 
^iti&n circo—tancaa sudh aa wlthin-claaa pairing limit tha number of candidataa 
from tfbich a match moat ba drawn* Finally^ It ia iq^rativa that how>g«naity 
of ragrasalon aaaui^tiona ba tsated whan analyaia of covarianca ia to ba tha 
principal analytic tool* Sad thia not baan dcma in tha Follomp Stody^ tha 
analyaaa would not only hava baan arronaoua^ but dangaroualy mlalaading* Tha 
problama ancountarad in tha Followup Study ara an aloquant^ If unfortunata^ 
taatlaony to tha attantion thay should racaiva in futura program avaluationa« 
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